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Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36{a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 
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Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )□ Responsive to communication(s) filed on . 

2a)D This action is FINAL. 2b)|EI This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) [x] Claim(s) 1-20 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) KI Claim(s) 1-20 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) IEl The specification is objected to by the Examiner. 

10)IE1 The drawing(s) filed on 10 January 2002 is/are: a)D accepted or b)|EI objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1 .121 (d). 
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DETAILED ACTION 

Drawings 

1. The drawings are objected to because the drawings are replete with errors. For 
example, on page 6, line 21, reference is made to a "dialog management system 70", 
however, in Fig. 1 , reference number 70 is labeled as a "domain model". Other 
references in the specification, such as "responses 76" and "turn manager 72" on page 
6, lines 22-24, are not in any of the drawings. Additionally, reference numbers in the 
drawings, such as "utterance representation 21" in Fig. 1, are not mentioned in the 
specification. These are only a few examples of errors in the drawings that must be 
corrected. 

Corrected drawing sheets in compliance with 37 CFR 1.121(d) are required in 
reply to the Office action to avoid abandonment of the application. If the changes are 
not accepted by the examiner, the applicant will be notified and informed of any required 
corrective action in the next Office action. The objection to the drawings will not be held 
in abeyance. 

Specification 

2. The disclosure is objected to because of the following informalities: as explained 
above in reference to the drawings, the disclosure is replete with errors. In several 
instances, different parts are labeled with the same number, references in the 
specification are not included in the drawings, and references in the drawings are not 
included in the specification. 
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Appropriate correction is required. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1-20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Claassen (U.S. Patent 6,647,363), in view of Monaco et al. (U.S. Patent 6,314,402), and 
further in view of Surace etal. (U.S. Patent 6,334,103). 

In regard to claims 1 and 19, Claassen discloses a computerized interface for 
managing a dialog between a computer and a user of the computer, the computer 
having an audio input device (Fig. 1, input interconnection 20, column 6, lines 18-21) 
and an audio output device (output interconnection 80, column 7, lines 54-57), the 
computerized interface comprising: 

a dialog manager for generating responses (presentation manager 90 selects a 
presentation scenario from database 96 and fills in the presentation scenario with 
information supplied by dialog manager 50, column 7, line 62 through column 8, line 4); 
and 

a turn manager for managing audible rendering of the responses through the 
audio output device, so that the user receives each response as part of a dialog 
between the computer and the user, the turn manager conducting the dialog that is 



Application/Control Number: 10/044,647 Page 4 

Art Unit: 2655 

subject to control by the user (dialog manager 50 determines what information the user 
is interested in, column 6, lines 52-54; and determines the intention of the user and 
passes this information to the presentation manager 90 to select an appropriate 
response, column 9, lines 36-38 and lines 58-63; presentation manager 90 then 
supplies the completed response to speech generation system 60, column 8, lines 4-6). 

Claassen further discloses that presentation manager 90 determines if the 
information to be presented to the user exceeds a complexity level (column 10, lines 62- 
66). If so, the presentation manager prompts the user to determine if the user would 
like to receive all of the information (column 11, lines 16-20). 

Claassen does not disclose that the responses are retained in a queue or that 
the dialog manager (presentation manager 90) places the generated responses in a 
queue. 

Monaco et al. discloses an interactive voice response system that includes a 
queue for retaining responses (prompts). The queue allows a prompt to be constructed 
from multiple pieces (column 10, lines 32-37). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify Claassen to include a queue so that if the user chose to receive the 
complex information, the complex information could be easily constructed from multiple 
pieces, as taught by Monaco et al. (column 10, lines 35-36). 

Neither Claassen nor Monaco et al. explicitly disclose that the dialogs are 
conducted in a polite manner. 
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Surace et al. discloses a voice user interface with a personality that follows a set 
of politeness rules when interacting with the user (Fig. 7 and column 1 0, lines 9-21 ). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to further modify the combination of Claassen and Monaco et al. to employ 
politeness rules to ensure the dialogs were conducted in a polite manner, since this 
would make the interaction more pleasant for the user. 

In regard to claims 7, 13, and 20, Claassen discloses a method for managing a 
dialog between a computer and a user of the computer, the computer having an audio 
input device (input interconnection 20, column 6, lines 18-21) and an audio output 
device (output interconnection 80, column 7, lines 54-57), the method comprising the 
computer-implemented steps of: 

receiving responses generated by the computer to spoken input from the user 
and received by the computer through the audio input device (Fig. 2, step 213, column 
11, lines 51-53); 

managing audible rendering of the responses through the audio output device 
(step 250, generated phrases are uttered, column 12, lines 18-19), so that the user 
receives each response as part of a dialog between the computer and the user (after 
the generated phrases are uttered, the dialog phase at step 210 is reentered, wherein 
the user can continue the dialog at step 213, column 12, lines 30-31 and column 1 1 , 
liens 51-53), the dialog conducted in a polite manner that is subject to control by the 
user (in step 214 it is determined which information the user is interested in, the 
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intentions of the user serving to control which presentations are returned to the user as 
speech, column 11, lines 54-57, column 12, lines 2-7 and lines 16-19). 

Claassen further discloses that presentation manager 90 determines if the 
information to be presented to the user exceeds a complexity level (column 10, lines 62- 
66). If so, the presentation manager prompts the user to determine if the user would 
like to receive all of the information (column 1 1 , lines 1 6-20). 

Claassen does not disclose placing the generated responses in a queue and 
managing the rendering of the responses from the queue. 

Monaco et al. discloses an interactive voice response system that includes a 
queue for retaining responses (prompts). The queue allows a prompt to be constructed 
from multiple pieces (column 10, lines 32-37). ' 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify Claassen to include a queue so that if the user chose to receive the 
complex information, the complex information could be easily constructed from multiple 
pieces, as taught by Monaco et al. (column 10, lines 35-36). 

Neither Claassen nor Monaco et al. explicitly disclose that the dialogs are 
conducted in a polite manner. 

Surace et al. discloses a voice user interface with a personality that follows a set 
of politeness rules when interacting with the user (Fig. 7 and column 10, lines 9-21). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to further modify the combination of Claassen and Monaco et al. to employ 
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politeness rules to ensure the dialogs were conducted in a polite manner, since this 
would make the interaction more pleasant for the user. 

In regard to claims 2, 8, and 14, Claassen discloses the turn manager is subject 
to behavioral goals that include: 

providing speech output including audible renditions of the responses when 
spoken to by the user (dialog manager 50 scans the output of speech recognizer 40 to 
determine the intention of the user, column 9, lines 36-42; presentation manager 90 
then selects a presentation that is returned to speech generation system 60 for 
presentation to the user as speech, column 9, lines 58-63 and column 8, lines 4-6); 

asking permission of the user before providing speech output based on delayed 
answers (details) and notifications (if the complexity of a presentation exceeds a 
threshold, presentation manager 90 asks permission before presenting the details to the 
user, column 11, lines 16-24); and 

allowing the user to (ii) interrupt in the dialog (the system detects the barging-in 
of a user during a presentation, column 10, lines 24-26). 

In regard to claims 3, 9, and 15, Claassen discloses the turn manager provides 
the audible rendering of the responses in a delivery mode subject to selection by the 
user (the user selects from various delivery modes such as 'fast, 'detail' and 'overview', 
column 9, lines 42-49). 
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In regard to claims 4, 10, and 16, Claassen discloses the delivery mode is one of 
an immediate delivery mode and a delayed delivery mode ('fast' delivery mode gives an 
immediate to the point presentation scenario, column 9, lines 46-49; while if the user 
selects a slower delivery mode, the information is presented in smaller pieces, providing 
a delayed delivery mode so the user can write down the information, column 1 0, lines 
35-49). 

In regard to claims 5, 1 1 , and 17, Claassen discloses the turn manager manages 
the audible rendering of the responses based on dialog states that specify the current 
state of the dialog between the computer and the user (the moment that a user barges- 
in in a dialog is used to determine the intention of the user, the intention is then used to 
select what information is presented to the user by presentation manager 90, column 
10, lines 47-58). 

In regard to claims 6, 12, and 18, Claassen discloses the response is an 
announcement of an event of interest (departure/arrival times) to the user as 
determined by the computer (dialog manager 50 determines what information the user 
is interested in, column 6, lines 52-54; then provides the departure/arrival times to the 
user, column 8, lines 2-7). 



Conclusion 
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The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Badt et al. (U.S. Patent 6,542,868) discloses a notification 
manager for a computer system that stores notifications in a queue and asks the user's 
permission before playing the notification. Comerford et al. (U.S. Patent 6,748,361) 
discloses dialog manager that utilizes a queue for responses. Fukui et al. (U.S. Patent 
5,918,222) discloses a polite dialog controller that lets the user control the dialog. 
Brown et al. (U.S. Patent 6,604,075) discloses a voice dialog interface that waits for a 
user's permission before presenting a response. Cooper et al. (U.S. Patent 6,466,654) 
discloses a virtual personal assistant that alerts a user with a whisper tone when the 
user has a call and asks the user's permission to put the call through. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Brian L Albertalli whose telephone number is (703) 305- 
1817. The examiner can normally be reached on Mon - Fri, 8:00 AM - 5:30 PM, every 
second Fri off. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Talivaldis Smits can be reached on (703) 305-301 1. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

BLA 12/1/04 
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